On 
O 
00 

o 



CLNS 08/2040 
CLEO 08-22 

Observation of r q / decays to 7r + 7r _ 7r° and 7T + 7T~e + e~ 

P. Naik, 1 J. Rademacker, 1 D. M. Asner, 2 K. W. Edwards, 2 J. Reed, 2 A. N. Robichaud, 2 
G. Tatishvili, 2 R. A. Briere, 3 H. Vogel, 3 P. U. E. Onyisi, 4 J. L. Rosner, 4 J. P. Alexander, 5 
D. G. Cassel, 5 J. E. Duboscq, 5 'Q R. Ehrlich, 5 L. Fields, 5 R. S. Galik, 5 L. Gibbons, 5 
R. Gray, 5 S. W. Gray, 5 D. L. Hartill, 5 B. K. Heltsley, 5 D. Hertz, 5 J. M. Hunt, 5 
J. Kandaswamy, 5 D. L. Kreinick, 5 V. E. Kuznetsov, 5 J. Ledoux, 5 H. Mahlke-Kriiger, 5 
D. Mohapatra, 5 J. R. Patterson, 5 D. Peterson, 5 D. Riley, 5 A. Ryd, 5 A. J. SadofT, 5 X. Shi, 5 
S. Stroiney, 5 W. M. Sun, 5 T. Wilksen, 5 S. B. Athar, 6 J. Yelton, 6 P. Rubin, 7 S. Mehrabyan, 8 

N. Lowrey, 8 M. Selen, 8 E. J. White, 8 J. Wiss, 8 R. E. Mitchell, 9 M. R. Shepherd, 9 
D. Besson, 10 T. K. Pedlar, 11 D. Cronin-Hennessy, 12 K. Y. Gao, 12 J. Hietala, 12 Y. Kubota, 12 
^ ! T. Klein, 12 R. Poling, 12 A. W. Scott, 12 P. Zweber, 12 S. Dobbs, 13 Z. Metreveli, 13 

K. K. Seth, 13 B. J. Y. Tan, 13 A. Tomaradze, 13 J. Libby, 14 L. Martin, 14 A. Powell, 14 
G. Wilkinson, 14 H. Mendez, 15 J. Y. Ge, 16 D. H. Miller, 16 V. Pavlunin, 16 B. Sanghi, 16 
I. P. J. Shipsey, 16 B. Xin, 16 G. S. Adams, 17 D. Hu, 17 B. Moziak, 17 J. Napolitano, 17 
Q. He, 18 J. Insler, 18 H. Muramatsu, 18 C. S. Park, 18 E. H. Thorndike, 18 F. Yang, 18 
>^ ■ M. Artuso, 19 S. Blusk, 19 S. Khalil, 19 J. Li, 19 R. Mountain, 19 K. Randrianarivony, 19 

V : N. Sultana, 19 T. Skwarnicki, 19 S. Stone, 19 J. C. Wang, 19 L. M. Zhang, 19 

G. Bonvicini, 20 D. Cinabro, 20 M. Dubrovin, 20 A. Lincoln, 20 and K. M. Ecklund 21 

43 : 

(CLEO Collaboration) 

^ \ 1 University of Bristol, Bristol BS8 1TL, UK 

^ • 2 Carleton University, Ottawa, Ontario, Canada K1S 5B6 

3 Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA 
^Enrico Fermi Institute, University of Chicago, Chicago, Illinois 60637, USA 
5 Cornell University, Ithaca, New York 14853, USA 
6 University of Florida, Gainesville, Florida 32611, USA 
1 George Mason University, Fairfax, Virginia 22030, USA 
8 University of Illinois, Urbana- Champaign, Illinois 61801, USA 
\ 9 Indiana University, Bloomington, Indiana 47405, USA 

^ ■ 10 University of Kansas, Lawrence, Kansas 66045, USA 

11 Luther College, Decorah, Iowa 52101, USA 
12 University of Minnesota, Minneapolis, Minnesota 55455, USA 
13 Northwestern University, Evanston, Illinois 60208, USA 

u University of Oxford, Oxford OX1 3RH, UK 
15 University of Puerto Rico, Mayaguez, Puerto Rico 00681 
16 Purdue University, West Lafayette, Indiana 47907, USA 
17 Rensselaer Polytechnic Institute, Troy, New York 12180, USA 
18 University of Rochester, Rochester, New York 14627, USA 
19 Syracuse University, Syracuse, New York 13244, USA 
20 Wayne State University, Detroit, Michigan 48202, USA 
21 Rice University, Houston, Texas 77005, USA 
(Dated: September 15, 2008) 



1 



Abstract 

Using ip(2S)^Tr + Tr~ J/tp, J/ip — ► Ji]' events acquired with the CLEO-c detector at the CESR 
e + e~ collider, we make the first observations of the decays rj' — > 7r + 7r~7r° and rj' — ► 7r + 7r~e + e~, 
measuring absolute branching fractions (S?! 1 ^ ± 4) x 1CT 4 and (25^ 1 g ± 5) x 10~ 4 , respectively. 
For rj' — > 7T + 7r _ 7r°, this result probes the mechanism of isospin violation and the roles of ir° /rj/rj'- 
mixing and final state rescattering in strong decays. We also set upper limits on branching fractions 
for rj' decays to it + ir~ ji + ji~ , 2(-7r + 7r~), 7r + 7r~27r°, 2(7r + 7r~)-7r , 3(-7r + 7r~), and invisible final states. 

PACS numbers: 13.25.Jx, 13.20.Jf 
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Four decades after the first observation of the rj' meson, its decays continue to pro- 
vide a useful laboratory for probing strong interactions and new physics. Theoretical and 
experimental interest remains robust, in part because some expected modes have not yet 
been observed at all and some rare or forbidden modes have not been adequately limited. 
For example, of all possible multi-pion r/' decays, only 7]' — > 37r° has been observed and 
branching fraction limits for others are not stringent, lying in the range of (1-9)% @,SB,3- 
No rj' decays with an e + e~ in the final state have been seen, and just one with a dimuon 
{rj 1 — > 7/i + yU~~) has been measured. New physics would be indicated by invisible decays 
rj' — > X; i.e., decays that leave no trace in any detector because they are composed of 
weakly interacting particles such as light dark matter. BES (6[ has set the only such limit, 
B(r)' -f J) < 14 x 1(T 4 at 90% confidence level (C.L.). 

Decay rates for three-pion decays of rj' are commonly expressed relative to 
their respective irnrj branching fractions because they could arise from rj-n mix- 
ing: r = B{r)' -f 3n°)/B(rj' -> vrVr/) = (75 ± 13) x 10" 4 Q and r± = 
B(r]_l — > 7r + 7T~7r ) /B(rj' — ► -K+n^rj). The decay rj' — > 7r + 7r _ 7r has garnered attention [El, 
10] both because experimental limits 0, H, 0, @] are large and because its rate can 



probe isospin symmetry breaking. Under the two assumptions that 7r + 7r~7r° appears only 
through rj ' — > 7T + 7T~rj followed by rj — it mixing and that such decays populate the available 
phase space uniformly, r± is found to be proportional to the light quark mass difference 
(m u — rrid) [llj and implies r±/r — 0.37 [jjj]. Suggesting neither assumption is justified, 
Ref. [13] employs the framework of £7(3) chiral effective field theory [l3[ to examine rj ' de- 



cays. The incorporation of measured [14j rj ' — > mrrj Dalitz slope parameters implies a large 
contribution to rj' — > 7r + 7r~7r° from final state rescattering: the prediction is that r±/r ~ 5 
and that dramatic structure should be present in the 7r + 7r~7r° Dalitz plot. 

Branching fractions for rj' — > l + l~X (I = e ± ,/i ± ) are expected to scale with those 
for rj' — > jX; the most copious dileptonic decay should be rj' — > 7r + 7r _ e + e _ . Since 
other 7T° and rj decays to e + e~X occur at ~1% [7] of the correspondin g ^ X decay, 



B[rj' — > -K + -K~e + e~) ~ 0.3% is expected. Two different theoretical approaches [15|, Il6| both 
predict Birj' — > 7r + 7r _ e + e _ ) ~ 0.2%, p°-dominance for the 7r + 7r~, and an e + e~ mass distribu- 
tion peaking just above 2m e but with a long tail extending to ~300 MeV. The experimental 



limit is B[rj' — > tt + -k e + e ) < 0.6% [17j. The corresponding dimuon channel is expected to 



be much rarer, with predictions of B[rj' — > tt + it~ ji + fj,~) ~ 2 x 10 |15l . [I6j and no experi- 
mental limit extant. 

In this Letter we search for decays of the rj' meson to eight final states: 7r + 7r _ 7r°, 
7r + 7r~e + e~, 7r + 7r~/i + /i~, 2(7r + 7r _ ), 3(7r + 7r~), 2(7r + 7r~)7r°, 7t + tt~2tt°, and X. Yields are nor- 
malized using the well-established decay chain rj' — > 7i + 7T^rj, rj 77, hereafter denoted as 
rj' — > 7r + 7r~?7[77], which was successfully used in a recent CLEO measurement [18| of the rj ' 
mass and found to provide a virtually background-free event sample. Events were acquired 
at the CESR e + e~ collider with the CLEO detector [19:], mostly in the CLEO-c configura- 
tion (95%) with the balance from CLEO III. The data sample corresponds to 27xl0 6 (2p| 
produced ip(2S) mesons, of which about 4xl0 4 decay as ip{2S)^it + -K~ J/ip, J ftp — > jrj'. 

For all the exclusive decay modes (i.e., all but invisible), event selection requires finding 
every particle in the decay. The tracking system must find exactly two oppositely-charged 
particles for the transition dipion, and two, four, or six more tracks of net charge zero, 
allowing for multiple combinations per event (which tends not to occur). Photon candidates 
must have energy exceeding 37 MeV, and either be more than 30 cm from any shower 
associated with one of the charged pions, or, when between 15 and 30 cm from such a 
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shower, have a photon-like lateral shower profile. Showers are rejected as photon candidates 
if they lie near the projection of any charged pion's trajectory into the calorimeter, or align 
with the initial momentum of any candidate within 100 mrad. Photon candidates are 
ordered by energy, with the most energetic always taken as the radiative photon from the 
J/if>, and subsequent ones, if required, must be taken as from the rj' . That is, a shower can 
be included in the decay chain only if every other photon of higher energy has also been 
used. Photon pairs are candidates for a tt° or rj if their invariant mass satisfies M(77)=115- 
150 MeV or 500-580 MeV, respectively, and are then constrained to the known tt° or r\ 
masses Q. 

All decay products are constrained to originate from a single point (vertex) consistent 
with the beam spot. The vertex-constrained event is additionally constrained to the known 
ip(2S) mass [7j and three- momentum, including the effect of the ~3 mrad crossing angle of 
the e + and e~ beams. Quality restrictions are applied to both the vertex (xy/d.o.f. < 10) 
and full event four-momentum (x^/d.o.f. < 10) kinematic fits. From this point onward, 
all selections are based upon the four-momenta obtained from the kinematic fit so as to 
improve resolutions. The mass recoiling against the if)(2S)-to-J/if> transition dipion must 
lie in the range 3092-3102 MeV. The invariant mass of the rj' candidate, M(jj'), must lie in 
the window 952-964 MeV. For the exclusive modes [rj' — > I], sidebands in M(jj') [E*] are 
used to extrapolate a linear background level into the signal region. Sideband intervals are, 
for M(rj'), 916-940 or 976-1000 MeV, and, for E*, 1220-1320 or 1460-1560 MeV. 

Candidates for 7r + 7r~e + e~ are additionally required to have an e + e~ invariant mass 
M(e + e~) below 100 MeV and which lies outside a window of 8-25 MeV, as well as to pass a 
tighter vertexing criterion, x^/d.o.f. < 3. These restrictions act to suppress feed-across from 
rj' — > 7r + 7r~7 when the photon converts in the material in the vacuum pipe or detectors. 
In such events the conversion electrons vertex poorly with the other tracks and the beam 
spot. When forced to form a common vertex with other tracks, M(e + e~) tends to be in the 
window 8-25 MeV due to the the discrete locations of the material. Similar restrictions were 
used effectively in Ref. 2l| in the selection of rj —+ ^e + e~ events. 

No lepton identification is required for 7r + 7r _ e + e~ or n + -k~ ji + ji~ candidate events. In- 
stead, all combinations of pion and lepton mass assignments are made to the four charged 
particles assigned to be the rj' decay products, and only those satisfying the respective 
kinematic fit are retained. Background from 7r + 7r~7 conversions with incorrectly swapped 
mass assignments {i.e., when a pion is mistakenly assigned the electron mass and an 
electron the pion mass) are suppressed by the M(e + e~) < 100 MeV requirement; the 
M(e + e~) = 8 — 25 MeV veto eliminates conversion background with correct mass assign- 
ments. 

Candidates for rj ' — > 7r + 7r~7r° are additionally required to pass a more restrictive criterion 
for the four-momentum fit of xi;/d.o.f. < 3 to suppress feed-across from rj' — > 7r + 7r~7, which 
fakes 7T + 7r~7r° when a shower from a pion interaction in the calorimeter is erroneously taken 
as a photon candidate and happens to form a 7r° candidate with the real photon from 
the r\' decay. For 7r + 7r~27r°, the four-momentum fit must have xi;/d.o.f. < 3 to suppress 
background from other J/if> decays. For rj' — > (2, 3)(7r + 7r~), the photon from the J /if} 
decay may not pair with any other photon candidate in the event to form a tt° or rj so 
as to suppress backgrounds from J/ip — > (2, 3)(7r + 7r _ )(7r /^). To reduce feedacross from 
rj' — > 7r + 7T~?7[7r + 7r~7r ] into rj' — > 2(7r + 7r~)7r°, candidates must not contain a three-pion 
combination that satisfies a constraint to the rj mass with x^/d.o.f. < 10. The sum of all 
unused photon candidates' energies cannot exceed 75 MeV for 7r + 7r~27r in order to suppress 
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backgrounds with higher neutral multiplicities. 

Candidates for X decays are subject to a simpler set of criteria. Exactly two charged 
particles of opposite charge can be found in the event, and their recoil mass must lie in the 
same window as the exclusive decays. Signal events would have a monochromatic photon 
in the J/ip rest frame, so we require that the most energetic photon candidate must, when 
boosted into the J/ip center-of-mass using the dipion momentum, have energy E*=1340- 
1440 MeV. The sum of all unused photon candidates' energies must be less than 75 MeV. 
The above restrictions on excess charged and neutral energy are evaded by events in which 
the particles recoiling against the transition dipion and radiative photon do not enter the 
active fiducial volume of the detector; hence we require that the missing momentum must 
have | cos 6*| < 0.7, assuring the rejection of such events. Background from J/ip — > nn 
in which the neutron is undetected and the anti-neutron shower has energy in the signal 
window is suppressed by requiring the radiative photon to have a lateral profile consistent 
with that of an electromagnetic shower. 

Efficiencies for signal and feed-across from other rj ' decays are modeled with Monte Carlo 
(MC) samples that were generated using the EvtGen event generator |22], fed through a 



GEANT-based [23j detector simulation, and subjected to event selection criteria. All rj' 
decays are generated using phase space, except that for 7t + tt~1 + 1~ and 7r + 7r~7 we assume 
the dipion to come from a p°, and the M(l + l~) distributions have been tuned to match those 
of Ref. For invisible decays we use rj ' — > vv. 

The data exhibit signals for rj' — > 7r + 7r~7r° (24 events) and rj' — > 7r + 7r~e + e~ (8 events), 
with predicted background levels of 3.8 and 0.14 events, respectively. Distributions in M(rj ') 
appear in Fig. [TJ The signal level and corresponding 68% C.L. interval in each case are 
obtained by subtracting the estimated background and accounting for the statistics of signal- 
and sideband-region data as well as that of rj' — > 7r + 7r~7 MC samples using a procedure 
similar to that of Ref. [24J. We consider two sources of background, one peaking in the 
signal region (from other rj' decays, in these two cases the only significant channel being 
T) 1 — > 7r + 7r~7, normalized by branching fractions 0] relative to r\' — > 7r + 7r _ ?7[77]) and the 
second linear across the mass region. The former is estimated from a MC sample to be 1.3 
events for 7r + 7r~7r° and 0.14 events for 7r + 7r~e + e~, and the latter from the mass sidebands 
to be 2.5 and events, respectively. For 7r + 7r - e + e~, the two events between the signal and 
sideband regions are consistent with tails of the signal. 

Statistical significance for each signal is obtained from a large ensemble of simulated trials 
in which the backgrounds are thrown as appropriately-scaled Poisson distributions and the 
fraction of such trials in which the number of events meets or exceeds that of the data is 
determined. In both cases the significances exceed 6a. 

The number of events in the normalization mode, rj' — > 7i + 7i^rj[ / y , y], is evaluated in an 
identical manner as our signal modes, and has no appreciable peaking feedacross background; 
non-peaking backgrounds lead to a 0.2% overall subtraction. The absolute number of rj' — > 
7r + 7r _ 7][77] events is compatible with that expected from the size of our data sample, the 
MC efficiency for this mode, and PDG branching fractions Q. 

Figure [2] shows kinematic distributions for rj' — > 7r + 7r~7r° and 7r + 7r~e + e~; within the 
statistical precision of so few events, we observe consistency of the data with the MC predic- 
tions. In Fig. 2(a) the 77 mass distribution for the ir° candidate in rj' — > tt + 7t~7t° verifies the 
cleanliness of that sample. Of particular interest for the 77 ' — > 7r + 7r~7r° decay is the Dalitz 
plot distribution shown in Fig. Efb) and (c), where data and phase-space MC simulation 



are shown side by side (these can be compared to the prediction in Fig. 1 of Ref. 12j). We 
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compare the Dalitz plot population density of data points to the two predictions and find 
much better agreement with the phase-space model than with that of rescattering through 



p ± [12]. The E* distribution for rj' — > X appears in Fig. [3] and shows no indication of a 



signal. For the channels where no signals are apparent, we compute 90% CL. upper limits 
on the signal yields. 

Table I displays the numerical results for each mode. No data events within the M(j] ') 
signal window are seen for the modes TT + 7t~{i + fi~, 2(tt + it~), or 3(7r + 7r~); for 2(7r + 7r~)7r° 
we find one signal event with 0.5 background, and for 7r + 7r~27r°, 5 signal events with 2 
background. The production rate R of each mode relative to that of rj' — ► 7r + 7r _ ^[77] 
is defined as R = [B(r]' — > X)/B(r]' — > it + -K~ri) x E{r\ — > 77)], and the absolute branching 
fraction B = B{r] ' — > X) . R is obtained by dividing the yield by its efficiency relative to 
the normalization mode and the number of events in the normalization mode; B is obtained 
from R by multiplying it by (0.1753 ± 0.0056), the value of the denominator in R using 
branching fractions compiled in Ref. Q. Overall normalizations cancel in the values of 
R, as do some of the track- and photon-finding systematic errors, depending upon mode. 
Systematic errors include detector modeling, the background linearity assumption, and the 
possible presence of intermediate resonances, amounting to 10-20%, depending upon mode; 
however, statistical errors dominate the systematic uncertainties here. The final column 
shows previous measurements, if any, for each mode: our measurements provide the first 
limits for rj' — > 7r + 7r~ fi + and 7r + 7r~27r° and improve upon those for the other modes. 

In conclusion, we report the first observation of the decays rj' — > 7r + 7r~7r° and 77' — > 
7T + 7T~e + e~ and measurement of their branching fractions. We find E{r] ' — > 7i + tt~7i°) = 
(37^9 ± 4) x 10" 4 and r± = (83 ± 22) x 10~ 4 . Using the branching fractions of Ref. 0, 
we determine r±/r = 1.11 ± 0.35, more than 2 standard deviations above the 7T°-?7-mixing 



prediction of 0.37, and far below the chiral unitary framework prediction of 5 [12J. The 
dileptonic results B(r]' -» 7r + 7r - e+e~) = (25t 1 g ± 5) x 10~ 4 and B(r]' — > 7i + n'fi + ^) < 



2.4 x 10 4 are consistent with predictions I15|, |l6j. We also obtain first or improved branching 



fraction upper limits for 7] ' decays to multi-pion and invisible final states. 
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TABLE I: Results for r/' — > X search, showing for each mode X the efficiency relative to that of 
the normalization mode rj' —* 7r + 7r~?7[77], e/eo; the net number of signal events, after background 
subtractions, iV (or 90% C.L. upper limit where indicated with "<"); the branching fraction ratio 
R [see text]; the absolute branching fraction B = B(j]' — » X) and its previous upper limit P [tJ. 
Entries for R and B include systematic errors. 



Mode X 




N 


i?(io- 3 ) 


B(10~ 4 ) 


P(10" 4 


ir + ir~ '77 [77] 


1.00 


1756±42 








ir + ir~e + e~ 


0.55 
0.31 
2.14 


20.2j£J 
7 q+3.9 

<4.8 


2li^±2 
14t£±3 
<1.3 


37l^±4 
25l 1 |±5 
<2.4 


<500 
<60 


2(vr+7r-) 


1.02 


<2.3 


<1.4 


<2.4 


<100 


vr + vr"27r 


0.18 


<4.1 


<15 


<27 




2(vr + 7r-)vr 


0.21 


<3.6 


<11 


<20 


<100 


3(vr+7r-) 


0.47 


<2.3 


<3.0 


<5.3 


<100 


Invisible 


0.74 


<5.8 


<5.4 


<9.5 


<14 



s 



2540808-009 




920 940 960 980 1000 

M (if) (MeV) 

FIG. 1: Distributions in M{rj') for (a) rj' — > ir + ir~ir° and (b) rj 1 —* 7r + 7r~e + e~. Solid circles 
represent data (nonzero bin entries only), the dashed histogram is the sum of a linear background 
normalized to the sideband populations in data and feed-across from rj' — * 7r + 7r _ 7 normalized 
by branching fraction, the dotted histogram is the signal MC shape normalized to the observed 
signal level, and the solid line is the sum of dotted and dashed histograms. Solid (dashed) arrows 
indicate nominal signal (sideband) region boundaries; sidebands extend to the edges of the plots. 
All selection criteria are applied here except to M(r/'). 
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FIG. 2: Distributions in: (a) the invariant mass of the two photons in the 7r° candidate in rj' — > 
7T + 7T~7r ; (b) Dalitz variables y vs. \x\ for 77' — > 7r + 7r~7r°, uncorrected for efficiency, for data, where 
box absence or size indicates 0, 1, or 2 events in each 0.1-by-0.1 bin, and (c) from a phase-space 
MC simulation, where bin shading indicates relative population; (d) the e + e~ invariant mass for 
rj' — > 7r + 7r~e + e~; (e) the 7r + 7r~ invariant mass for r\' — ► 7r + 7r~e + e~. In (a), (d), and (e), solid 
circles represent the data, the dotted histogram is the MC signal shape normalized to the yields 
found in Table HI and the solid line is the sum of MC signal and predicted rj' — > 7r + 7r~7 feedacross. 
The region between the arrows indicates the selected region in (a) and an excluded region in (d). 
All selection criteria, including that upon M(r)'), are applied here, except to M(^yy) in (a) and to 
M(e + e~) in (d). The quantities x and y are defined as x = v3(T+ — T-)/Q, y = (3Tq/Q) — 1, To 
(T±) is the 7T° ('?r ± ) kinetic energy in the rj' center of mass, and Q = Tq + + T-. 
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FIG. 3: Distribution of E* (see text) for J/ifi — » 717', rj' — ► X candidate events. Solid circles 
represent data (nonzero bin entries only) , the dashed histogram is the linear background normalized 
to the sideband populations in data, the dotted histogram is the signal MC shape normalized to 
the the 90% C.L. upper limit, and the solid line is the sum of dotted and dashed histograms. Solid 
(dashed) arrows indicate nominal signal (sideband) region boundaries; sidebands extend to the 
edges of the plot. All selections are applied here except to E*. 
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